Peer Texting to Promote Quitline Use and Smoking Cessation Among Rural Participants in Vietnam: Randomized Clinical Trial.

Objectives: We tested an adapted version of an effective U.S.-based peer-texting intervention to promote Quitline use and smoking cessation among rural participants in Vietnam. Methods: We conducted a two-arm randomized trial with participants recruited at four rural community centers. The intervention included peer messages sent for six months that promoted Quitline use and smoking cessation. Additionally, biweekly two-way text messages assessed participants' interest in Quitline referral and current smoking status. Comparison participants received only the bi-weekly text message assessment of their current smoking status. At six months, we assessed Quitline use and smoking cessation. Smoking cessation was assessed using the 7-day point prevalence question and verified with a carbon monoxide breath monitor (<=6 ppm). Results: Among 750 participants, the intervention had higher Quitline verified use (18%, 95% CI 0.14, 0.22) than comparison (1%, 95% CI .2, 2, p < 0.0001). Carbon-monoxide-verified smoking cessation did not differ between the two groups. However, intervention (28.3%, 95% CI) and comparison (28.1%, 95% CI) participants had substantial rates of carbon monoxide cessation at 6 months (both 28%). Conclusion: Our study highlighted the promise of texting interventions to extend tobacco control efforts in Vietnam.

Clinician Attitudes Toward Suicide Prevention Practices and Their Implementation: Findings From the System of Safety Study.

OBJECTIVE: The authors aimed to assess clinicians' attitudes toward suicide-related practices and their implementation, across roles and settings, before implementation of the Zero Suicide model in a health care system. METHODS: Clinicians (N=5,559) were invited to complete a survey assessing demographic characteristics; confidence and self-reported suicide-related practice; leadership buy-in; and attitudes toward suicide prevention, safety planning, and continuous quality improvement (CQI). RESULTS: Of 1,224 respondents, most felt confident conducting suicide screening but less confident performing other suicide-related care. Provider role and care setting were significantly associated with confidence (p<0.001, Kruskal-Wallis H test) and practice (p<0.001, Kruskal-Wallis H test) of providing suicide prevention care, with behavioral health providers and providers in the emergency department (ED) reporting the highest confidence. Attitudes toward safety planning were more positive among women (p<0.001, t test) and behavioral health providers (p<0.001, F test) than among their counterparts or peers. Positive attitudes toward CQI were significantly associated with male sex (p=0.01), non-White race (p=0.03), younger age (p=0.02), fewer years working in health care (p<0.001), administrative role (p<0.001), working in the ED (p<0.001), outpatient settings (p<0.02), and medical provider role (p<0.001). CONCLUSIONS: Behavioral health providers and those in the ED reported feeling prepared to deliver suicide-related care, with nurses feeling less confident and less supported. Initiatives to improve suicide-related care should account for clinical role and care setting during planning. CQI could help engage a broader range of clinicians in suicide-related care improvements.

Comparing the Acceptability and Quality of Intervention Modalities for Suicidality in the Emergency Department: Randomized Feasibility Trial.

BACKGROUND: Emergency departments (EDs) manage many patients with suicide risk, but effective interventions for suicidality are challenging to implement in this setting. ReachCare is a technology-facilitated version of an evidence-based intervention for suicidal ED patients. Here, we present findings on the acceptability and quality of ReachCare in the ED, as well as a comparison of these measures across 3 potential delivery modalities. OBJECTIVE: Our aim was to test the feasibility of the ReachCare intervention in its entirety through conducting a pilot study with patients presenting with suicidality to the ED. We tested three different ways of receiving the ED-based components of ReachCare: (1) self-administered on the tablet app using a chatbot interface, (2) administered by an in-person clinician, or (3) administered by a telehealth clinician. METHODS: In total, 47 ED patients who screened positive for suicide risk were randomly allocated to receive one of three delivery modalities of ReachCare in the ED: (1) self-administered on the patient-facing tablet app with a chatbot interface, (2) delivered by an in-person clinician, or (3) delivered by a telehealth clinician, with the latter two using a clinician-facing web app. We measured demographic and clinical characteristics, acceptability and appropriateness of the intervention, and quality and completeness of the resulting safety plans. RESULTS: Patients assigned high ratings for the acceptability (median 4.00/5, IQR 4.00-4.50) and appropriateness (median 4.00/5, IQR 4.00-4.25) of ReachCare's ED components, and there were no substantial differences across the 3 delivery modalities [H(acceptability)=3.90, P=.14; H(appropriateness)=1.05, P=.59]. The self-administered modality took significantly less time than the 2 clinician modalities (H=27.91, P<.001), and the usability of the self-administered version was in the "very high" range (median 93.75/100, IQR 80.00-97.50). The safety plans created across all 3 modalities were high-quality (H=0.60, P=.74). CONCLUSIONS: Patients rated ReachCare in the ED as highly acceptable and appropriate regardless of modality. Self-administration may be a feasible way to ensure patients with suicide risk receive an intervention in resource constrained EDs. Limitations include small sample size and demographic differences between those enrolled versus not enrolled. Further research will examine the clinical outcomes of patients receiving both the in-ED and post-ED components of ReachCare. TRIAL REGISTRATION: ClinicalTrials.gov NCT04720911; https://clinicaltrials.gov/ct2/show/NCT04720911.

Effect of an Emergency Department Process Improvement Package on Suicide Prevention: The ED-SAFE 2 Cluster Randomized Clinical Trial.

Importance: Suicide is a leading cause of deaths in the US. Although the emergency department (ED) is an opportune setting, ED-initiated interventions remain underdeveloped and understudied. Objective: To determine if an ED process improvement package, with a subfocus on improving the implementation of collaborative safety planning, reduces subsequent suicide-related behaviors. Design, Setting, and Participants: The Emergency Department Safety Assessment and Follow-up Evaluation 2 (ED-SAFE 2) trial, a stepped-wedge cluster randomized clinical trial conducted in 8 EDs across the US, used an interrupted time series design with three 12-month sequential phases: baseline, implementation, and maintenance. A random sample of 25 patients per month per site 18 years and older who screened positive on the Patient Safety Screener, a validated suicide risk screener, were included. The primary analyses focused on those who were discharged from the ED, while secondary analyses focused on all patients who screened positive, regardless of disposition. Data were collected on patients who presented for care from January 2014 to April 2018, and data were analyzed from April to December 2022. Interventions: Each site received lean training and built a continuous quality improvement (CQI) team to evaluate the current suicide-related workflow in the ED, identify areas of improvement, and implement efforts to improve. Each site was expected to increase their universal suicide risk screening and implement collaborative safety planning for patients at risk of suicide who were discharged home from the ED. Site teams were centrally coached by engineers experienced in lean CQI and suicide prevention specialists. Main Outcomes and Measures: The primary outcome was a composite comprising death by suicide or suicide-related acute health care visits, measured over a 6-month follow-up window. Results: Across 3 phases, 2761 patient encounters were included in the analyses. Of these, 1391 (50.4%) were male, and the mean (SD) age was 37.4 (14.5) years. A total of 546 patients (19.8%) exhibited the suicide composite during the 6-month follow-up (9 [0.3%] died by suicide and 538 [19.5%] of a suicide-related acute health care visit). A significant difference was observed for the suicide composite outcome between the 3 phases (baseline, 216 of 1030 [21%]; implementation, 213 of 967 [22%]; maintenance, 117 of 764 [15.3%]; P = .001). The adjusted odds ratios of risk of the suicide composite during the maintenance phase was 0.57 (95% CI, 0.43-0.74) compared with baseline and 0.61 (0.46-0.79) compared with the implementation phase, which reflect a 43% and 39% reduction, respectively. Conclusions and Relevance: In this multisite randomized clinical trial, using CQI methods to implement a department-wide change in suicide-related practices, including the implementation of a safety plan intervention, yielded a significant decrease in suicide behaviors in the maintenance period of the study. Trial Registration: ClinicalTrials.gov Identifier: NCT02453243.

Accuracy of physician self-estimation of time spent during patient care in the emergency department.

Objective: Accurate measurement of physicians' time spent during patient care stands to inform emergency department (ED) improvement efforts. Direct observation is time consuming and cost prohibitive, so we sought to determine if physician self-estimation of time spent during patient care was accurate. Methods: We performed a prospective, convenience-sample study in which research assistants measured time spent by ED physicians in patient care. At the conclusion of each observed encounter, physicians estimated their time spent. Using Mann-Whitney U tests and Spearman's rho, we compared physician estimates to actual time spent and assessed for associations of encounter characteristics and physician estimation. Results: Among 214 encounters across 10 physicians, we observed a medium-sized correlation between actual and estimated time (Spearman's rho = 0.63, p < 0.001), and in aggregate, physicians underestimated time spent by a median of 0.1 min. An equal number of encounters were overestimated and underestimated. Underestimated encounters were underestimated by a median of 5.1 min (interquartile range [IQR] 2.5-9.8) and overestimated encounters were overestimated by a median of 4.3 min (IQR 2.5-11.6)-26.3% and 27.9% discrepancy, respectively. In terms of actual time spent, underestimated encounters (median 19.3 min, IQR 13.5-28.3) were significantly longer than overestimated encounters (median 15.3 min, IQR 11.3-20.5) (p < 0.001). Conclusions: Physician self-estimation of time spent was accurate in aggregate, providing evidence that it is a valid surrogate marker for larger-scale process improvement and research activities, but likely not at the encounter level. Investigations exploring mechanisms to augment physician self-estimation, including modeling and technological support, may yield pathways to make self-estimation valid also at the encounter level.

Pediatrician and Child Adolescent Psychiatrist Perspectives of Coordinated Care for Emerging Adults.

PURPOSE: To explore pediatrician and child/adolescent psychiatrists' perspectives of the role of coordinated care for emerging adults with serious mental health conditions, particularly as they transition to adult care. METHODS: Semi-structured individual interviews of a purposive sample of 10 pediatricians and 11 child/adolescent psychiatrists in Massachusetts were used to explore coordinated care for emerging adults. Following verbatim transcription and double coding, we conducted a thematic analysis to identify key themes. Care coordination concepts explored included a case discussion, teamwork, communication methods, medication management, transition to adult care, the healthcare home, and youth and family role. Organizational and societal barriers were also discussed. RESULTS: Providers described key barriers to continuous, coordinated care for youth with serious mental health conditions, including poor communication systems between providers, no organized process for the transition from pediatric to adult care, state licensing laws (particularly impacting college-age youth), inadequate connection to community supports, and poor reimbursement rates for psychiatric care. Termination of primary care in young adults and inadequate medication side effect monitoring were described as key gaps in care. DISCUSSION: The current system of coordinated care for emerging adults with serious mental health conditions is a perfect storm of challenges that creates a vicious cycle of interconnected barriers which lead to fragmented, discontinuous, and sub-par care for this population.

ReachCare Mobile Apps for Patients Experiencing Suicidality in the Emergency Department: Development and Usability Testing Using Mixed Methods.

BACKGROUND: Many individuals with suicide risk present to acute care settings such as emergency departments (EDs). However, staffing and time constraints mean that many EDs are not well equipped to deliver evidence-based interventions for patients experiencing suicidality. An existing intervention initiated in the ED for patients with suicide risk (Emergency Department Safety Assessment and Follow-up Evaluation [ED-SAFE]) has been found to be effective but faces trenchant barriers for widespread adoption. OBJECTIVE: On the basis of the ED-SAFE intervention, we aimed to develop 2 apps for patients with suicide risk: a web app guiding patients through safety planning in the ED (ED app) and a smartphone app providing patients components of the ED-SAFE program on their phones after discharge (patient app). We then tested the usability of these apps with patients presenting to the ED with suicide risk. METHODS: Using a user-centered design framework, we first developed user personas to explore the needs and characteristics of patients who are at risk for suicide using inputs from clinicians (n=3) and suicidologists (n=4). Next, we validated these personas during interviews with individuals with lived experience of suicidality (n=6) and used them to inform our application designs. We field-tested the apps with ED patients presenting with suicide risk (n=14) in 2 iterative cycles to assess their usability and engagement using a mixed methods approach. We also rated the quality and fidelity of the safety plans created. RESULTS: We developed 2 interoperable and complementary apps. The first is a web app designed for use on a tablet device during ED admission that guides the patient by creating a safety plan using a chatbot-style interface. The second is a smartphone app for use after discharge and allows the patient to view, edit, and share their completed safety plan; access self-care education, helplines, and behavioral health referrals; and track follow-up appointments with the study clinician. The initial prototype usability testing (n=9) demonstrated satisfactory scores (ED app System Usability Scale [SUS], mean 78.6/100, SD 24.1; User Engagement Scale, mean 3.74/5, SD 0.72; patient app SUS, mean 81.7/100, SD 20.1). After refining the apps based on participant feedback, the second cycle testing (n=5) showed improvement (ED app SUS, mean 90.5/100, SD 9.9; User Engagement Scale, mean 4.07/5, SD 0.36; patient app SUS, mean 97.0/100, SD 1.9). The quality ratings for completed safety plans were satisfactory (Safety Planning Intervention Scoring Algorithm-Brief, mean 27.4, SD 3.4). CONCLUSIONS: By adopting a user-centered approach and creating personas to guide development, we were able to create apps for ED patients with suicide risk and obtain satisfactory usability, engagement, and quality scores. Developing digital health tools based on user-centered design principles that deliver evidence-based intervention components may help overcome trenchant implementation barriers in challenging health care settings.

Established Outpatient Care and Follow-Up After Acute Psychiatric Service Use Among Youths and Young Adults.

OBJECTIVE: This study explored follow-up after hospitalization and emergency room (ER) use for mental health among youths and young adults with private insurance. METHODS: The IBM MarketScan commercial database (2013-2018) was used to identify people ages 12-27 with a mental health hospitalization (N=95,153) or ER use (N=108,576). Factors associated with outpatient mental health follow-up within 7 and 30 days of discharge were determined via logistic models with generalized estimating equations that accounted for state variation. RESULTS: Of those hospitalized, 42.7% received follow-up within 7 days (67.4% within 30 days). Of those with ER use, 28.6% received follow-up within 7 days (46.4% within 30 days). Type of established outpatient care predicted follow-up after hospitalization and ER use. Compared with people with no established care, the likelihood of receiving follow-up within 7 days was highest among those with mental health and primary care (hospitalization, adjusted odds ratio [AOR]=2.81, 95% confidence interval [CI]=2.68-2.94; ER use, AOR=4.06, 95% CI=3.72-4.42), followed by those with mental health care only (hospitalization, AOR=2.57, 95% CI=2.45-2.70; ER use, AOR=3.48, 95% CI=3.17-3.82) and those with primary care only (hospitalization, AOR=1.20, 95% CI=1.15-1.26; ER use, AOR=1.22, 95% CI=1.16-1.28). Similar trends were observed within 30 days of discharge. CONCLUSIONS: Follow-up rates after acute mental health service use among youths and young adults were suboptimal. Having established mental health care more strongly predicted receiving follow-up than did having established primary care. Improving engagement with outpatient mental health care providers may increase follow-up rates.

Preventing Suicide in Health Systems: How Can Implementation Science Help?

Suicide prevention is an emotive, complex goal for clinicians and health systems. Effective interventions for suicidality do exist; however, many patients do not receive them because implementation efforts tend to be time-limited and unsystematic. Implementation science is the study of methods to promote the systematic uptake of research findings and other evidence-based practices into routine practice. This narrative review introduces implementation science to suicide researchers, with a special focus on healthcare settings. We outline prominent theories, methods, and measures, as well as examples of implementation research from suicidology. By embracing the principles of implementation science, suicidologists can help to close the gap between evidence-based practice and routine practice, thereby improving the delivery and uptake of suicide-related interventions and prevention programs.

Studying the implementation of Zero Suicide in a large health system: Challenges, adaptations, and lessons learned.

Background: Suicide remains the 10th leading cause of death in the United States. Many patients presenting to healthcare settings with suicide risk are not identified and their risk mitigated during routine care. Our aim is to describe the planned methodology for studying the implementation of the Zero Suicide framework, a systems-based model designed to improve suicide risk detection and treatment, within a large healthcare system. Methods: We planned to use a stepped wedge design to roll-out the Zero Suicide framework over 4 years with a total of 39 clinical units, spanning emergency department, inpatient, and outpatient settings, involving ∼310,000 patients. We used Lean, a widely adopted a continuous quality improvement (CQI) model, to implement improvements using a centralize "hub" working with smaller "spoke" teams comprising CQI personnel, unit managers, and frontline staff. Results: Over the course of the study, five major disruptions impacted our research methods, including a change in The Joint Commission's safety standards for suicide risk mitigation yielding massive system-wide changes and the COVID-19 pandemic. What had been an ambitious program at onset became increasingly challenging because of the disruptions, requiring significant adaptations to our implementation approach and our study methods. Conclusions: Real-life obstacles interfered markedly with our plans. While we were ultimately successful in implementing Zero Suicide, these obstacles led to adaptations to our approach and timeline and required substantial changes in our study methodology. Future studies of quality improvement efforts that cut across multiple units and settings within a given health system should avoid using a stepped-wedge design with randomization at the unit level if there is the potential for sentinel, system-wide events.

Suicide Screening Tools for Pediatric Emergency Department Patients: A Systematic Review.

Background: According to the Centers for Disease Control and Prevention, suicidality and suicidal behavior among youth continues to increase significantly each year. Many of those who die by suicide interact with health services in the year before death. This systematic review sought to identify and describe empirically tested screening tools for suicidality in youth presenting to Emergency Departments (ED). Objective: (1) To identify and compare existing tools used to screen for suicidality in children and adolescents who present to the ED and (2) to ascertain the prevalence of suicidality in pediatric populations found with these tools. Methods: We searched Ovid Medline, CINAHL, Scopus, and Cochrane databases for primary research studies that identified and evaluated screening tools for suicide risk in pediatric ED patients. A total of 7,597 publications published before August 25, 2021 met search criteria and were screened by two independent reviewers based on our inclusion and exclusion criteria, with any conflicts resolved via consensus meetings or an independent reviewer. A total of 110 papers were selected for full text review, of which 67 were excluded upon further inspection. Covidence was used to extract and synthesize results. Results: 43 articles were eligible for inclusion. Most studies (n = 33) took place in general pediatric EDs; the quality was generally high. Patients ranged from 4-24 years old, with most screening tested in patients 12 years and older. The most researched tools were the Ask-Suicide Screening Questions (ASQ) (n = 15), Columbia-Suicide Severity Rating Scale (C-SSRS) (n = 12), Suicidal Ideation Questionnaire (SIQ) (n = 11), and the Risk of Suicide Questionnaire (RSQ) (n = 7). Where screening was applied to all patients, about one-fifth of pediatric ED patients screened positive; where suicide screening was applied to psychiatric patients only, over half screened positive. Positive screens were more likely to be female and older than negative screens and they were more likely to be assessed and admitted. Conclusion: Several validated screening tools exist for the purpose of screening pediatric populations in EDs for suicidality. Such tools may help to support early detection and appropriate intervention for youth at risk of suicide. Systematic Review Registration: https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=276328, identifier: 276328.

Psychosocial and psychiatric factors preceding death by suicide: A case-control psychological autopsy study involving multiple data sources.

BACKGROUND: A range of factors including mental disorders and adverse life events can increase the risk of suicide. The objectives of this study were to examine psychosocial and psychiatric factors and service engagement among suicide decedents compared with living controls. METHODS: A case-control study using multiple sources was conducted. Information on 132 consecutive cases of suicide was drawn from coronial files, and interviews were carried out with 35 family informants and 53 living controls. GPs completed questionnaires for 60 suicide cases and 27 controls. RESULTS: The majority (83.3%) of suicide decedents had contacted a GP in the year prior to death, while 23.3% had 10 or more consultations during the year prior to death. Half of suicide decedents had a history of self-harm. Suicide cases were significantly more likely than controls to have a psychiatric diagnosis (60% vs. 18.5%) and a depressive illness (36.7% vs. 14.8%). Over one-quarter of suicide decedents had been treated as a psychiatric inpatient. DISCUSSION: Primary care providers should be supported to deliver multidisciplinary interventions to engage, assess, and treat patients at risk of suicide, targeting those who present very frequently, those with a history of self-harm or substance misuse, and those with psychological presentations.

Healthcare use in commercially insured youth with mental health disorders.

BACKGROUND: The objective of this study is to describe age-related patterns of outpatient healthcare utilization in youth and young adults with mental health disorders. METHOD: We used the IBM® MarketScan® Commercial Database to identify 359,413 youth and young adults (12-27 years) with a mental health disorder continuously enrolled in private health insurance in 2018. Exploratory analysis was used to describe patterns of outpatient healthcare use (e.g., primary, reproductive, mental health care) and therapeutic management (e.g., medication prescriptions, psychotherapy) by age. Period prevalence and median number of visits are reported. Additional analysis explored utilization patterns by mental health disorder. RESULTS: The prevalence of outpatient mental health care and primary care decreased with age, with a larger drop in primary care utilization. While 74.0-78.4% of those aged 12-17 years used both outpatient mental health care and primary care, 53.1-59.7% of those aged 18-27 years did. Most 18-19-year-olds had a visit with an internal medicine or family medicine specialist, a minority had a pediatrician visit. The prevalence of medication management increased with age, while the prevalence of psychotherapy decreased. CONCLUSIONS: Taken together, this descriptive study illustrates age-related differences in outpatient healthcare utilization among those with mental health disorders. Additionally, those with the most severe mental health disorders seem to be least connected to outpatient care. This knowledge can inform efforts to improve utilization of healthcare across the transition to adulthood.

Understanding the Role of Clinical Champions and Their Impact on Clinician Behavior Change: The Need for Causal Pathway Mechanisms.

Background: The clinical champion approach is a highly utilized implementation strategy used to mitigate barriers and improve outcomes of implementation efforts. Clinical champions are particularly effective at addressing provider-level barriers and promoting provider-behavior change. Yet, the specific causal pathways that explain how clinical champions impact provider behavior change have not been well-explicated. The current paper applies behavior change models to develop potential causal pathway mechanisms. Methods: The proposed mechanisms are informed by previous literature involving clinical champions and empirically supported behavior change models. These models are applied to link specific attributes to different stages of behavior change and barriers for providers. Results: Two unique pathway mechanisms were developed, one that explicates how providers develop intention to use EBPs, while the other explicates how providers transition to EBP use and sustainment. Clinical champions may promote intention development through behavioral modeling and peer buy-in. In contrast, champions promote behavioral enactment through skill building and peer mentorship. Conclusion: Clinical champions likely play a critical role in reducing provider implementation barriers for providers across various phases of behavior change. The proposed pathways provide potential explanations for how clinical champions promote provider behavior change. Future research should prioritize empirically testing causal pathway mechanisms.

mHealth Messaging to Motivate Quitline Use and Quitting: Protocol for a Community-Based Randomized Controlled Trial in Rural Vietnam.

BACKGROUND: Tobacco kills more than 8 million people each year, mostly in low- and middle-income countries. In Vietnam, 1 in every 2 male adults smokes tobacco. Vietnam has set up telephone Quitline counseling that is available to all smokers, but it is underused. We previously developed an automated and effective motivational text messaging system to support smoking cessation among US smokers. OBJECTIVE: The aim of this study is to adapt the aforementioned system for rural Vietnamese smokers to promote cessation of tobacco use, both directly and by increasing the use of telephone Quitline counseling services and nicotine replacement therapy. Moreover, we seek to enhance research and health service capacity in Vietnam. METHODS: We are testing the effectiveness of our culturally adapted motivational text messaging system by using a community-based randomized controlled trial design (N=600). Participants were randomly allocated to the intervention (regular motivational and assessment text messages) or control condition (assessment text messages only) for a period of 6 months. Trial recruitment took place in four communes in the Hung Yen province in the Red River Delta region of Vietnam. Recruitment events were advertised to the local community, facilitated by community health workers, and occurred in the commune health center. We are assessing the impact of the texting system on 6-month self-reported and biochemically verified smoking cessation, as well as smoking self-efficacy, uptake of the Quitline, and use of nicotine replacement therapy. In addition to conducting the trial, the research team also provided ongoing training and consultation with the Quitline during the study period. RESULTS: Site preparation, staff training, intervention adaptation, participant recruitment, and baseline data collection were completed. The study was funded in August 2017; it was reviewed and approved by the University of Massachusetts Medical School Institutional Review Board in 2017. Recruitment began in November 2018. A total of 750 participants were recruited from four communes, and 700 (93.3%) participants completed follow-up by March 2021. An analysis of the trial results is in progress; results are expected to be published in late 2022. CONCLUSIONS: This study examines the effectiveness of mobile health interventions for smoking in rural areas in low- and middle-income countries, which can be implemented nationwide if proven effective. In addition, it also facilitates significant collaboration and capacity building among a variety of international partners, including researchers, policy makers, Quitline counselors, and community health workers. TRIAL REGISTRATION: ClinicalTrials.gov NCT03567993; https://clinicaltrials.gov/ct2/show/NCT03567993. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID): DERR1-10.2196/30947.

Applying Machine Learning Approaches to Suicide Prediction Using Healthcare Data: Overview and Future Directions.

Objective: Early identification of individuals who are at risk for suicide is crucial in supporting suicide prevention. Machine learning is emerging as a promising approach to support this objective. Machine learning is broadly defined as a set of mathematical models and computational algorithms designed to automatically learn complex patterns between predictors and outcomes from example data, without being explicitly programmed to do so. The model's performance continuously improves over time by learning from newly available data. Method: This concept paper explores how machine learning approaches applied to healthcare data obtained from electronic health records, including billing and claims data, can advance our ability to accurately predict future suicidal behavior. Results: We provide a general overview of machine learning concepts, summarize exemplar studies, describe continued challenges, and propose innovative research directions. Conclusion: Machine learning has potential for improving estimation of suicide risk, yet important challenges and opportunities remain. Further research can focus on incorporating evolving methods for addressing data imbalances, understanding factors that affect generalizability across samples and healthcare systems, expanding the richness of the data, leveraging newer machine learning approaches, and developing automatic learning systems.

Accuracy of emergency physicians' self-estimates of CT scan utilization and its potential effect on an audit and feedback intervention: a randomized trial.

BACKGROUND: Audit and feedback (A&F) has been used as a strategy to modify clinician behavior with moderate success. Although A&F is theorized to work by improving the accuracy of clinicians' estimates of their own behavior, few interventions have included assessment of clinicians' estimates at baseline to examine whether they account for intervention success or failure. We tested an A&F intervention to reduce computed tomography (CT) ordering by emergency physicians, while also examining the physicians' baseline estimates of their own behavior compared to peers. METHODS: Our study was a prospective, multi-site, 20-month, randomized trial to examine the effect of an A&F intervention on CT ordering rates, overall and by test subtype. From the electronic health record, we obtained 12 months of baseline CT ordering per 100 patients treated for every physician from four emergency departments. Those who were randomized to receive A&F were shown a de-identified graph of the group's baseline CT utilization, asked to estimate wherein the distribution of their own CT order practices fell, and then shown their actual performance. All participants also received a brief educational intervention. CT ordering rates were collected for all physicians for 6 months after the intervention. Pre-post ordering rates were compared using independent and repeated measures t tests. RESULTS: Fifty-one of 52 eligible physicians participated. The mean CT ordering rate increased significantly in both experimental conditions after the intervention (intervention pre = 35.7, post = 40.3, t = 4.13, p < 0.001; control pre = 33.9, post = 38.9, t = 3.94, p = 0.001), with no significant between-group difference observed at follow-up (t = 0.43, p = 0.67). Within the intervention group, physicians had poor accuracy in estimating their own ordering behavior at baseline: most overestimated and all guessed that they were in the upper half of the distribution of their peers. CT ordering increased regardless of self-estimate accuracy. CONCLUSIONS: Our A&F intervention failed to reduce physician CT ordering: our feedback to the physicians showed most of them that they had overestimated their CT ordering behavior, and they were therefore unlikely to reduce it as a result. After "audit," it may be prudent to assess baseline clinician awareness of behavior before moving toward a feedback intervention.

Operational factors associated with emergency department patient satisfaction: Analysis of the Academy of Administrators of Emergency Medicine/Association of Academic Chairs of Emergency Medicine national survey.

BACKGROUND: Patient satisfaction is a focus for emergency department (ED) and hospital administrators. ED patient satisfaction studies have tended to be single site and focused on patient and clinician factors. Inclusion of satisfaction scores in a large, national operations database provided an opportunity to conduct an investigation that included diverse operational factors. METHODS: We performed a retrospective analysis of the 2019 Academy of Administrators in Academic Emergency Medicine/Association of Academic Chairs of Emergency Medicine (AAAEM/AACEM) benchmarking survey to identify associations between operational factors and patient satisfaction. We identified 59 database variables as potential predictors of Press Ganey likelihood-to-recommend and physician overall scores. Using random forest modeling, we identified the top eight predictors in the models and described their associations. RESULTS: Forty-three (57.3%) academic departments responding to the AAAEM/AACEM survey reported patient satisfaction scores for 78 EDs. Likelihood to recommend ranged from 30.0 to 93.0 (median = 74.8) and was associated with ED length of stay, boarding, use of hallway spaces, hospital annual admissions, faculty base clinical hours, proportion of patients leaving before treatment complete (LBTC), and provider in triage hours per day. Physician overall score ranged from 53.3 to 93.4 (median = 81.9) and was associated with faculty base clinical hours, x-ray utilization, annual ED arrivals, LBTC, use of hallway spaces, arrivals per attending hour, and CT utilization. CONCLUSIONS: ED patient satisfaction was associated with intrinsic and extrinsic factors, some being potentially manageable within the ED but others being relatively fixed or outside the control of ED operations. For likelihood to recommend, patient flow was dominant, with erosion of satisfaction observed with increased boarding and longer LOS. Factors associated with physician overall score were more varied. The use of hallway spaces and base clinical hours greater than 1,500 per year were associated with both lower likelihood-to-recommend and lower physician overall scores.

The mental and physical health profile of people who died by suicide: findings from the Suicide Support and Information System.

PURPOSE: There is limited research on the associations between factors relating to mental and physical health in people who died by suicide. METHODS: Consecutive suicide cases were included in a psychological autopsy study as part of the Suicide Support and Information System in southern Ireland. Chi-square tests and logistic regression analysis were used to examine factors associated with recorded presence or absence of mental and physical health problems. RESULTS: The total sample comprised 307 suicide cases, the majority being male (80.1%). Sixty-five percent had a history of self-harm and 34.6% of these cases had not been seen or treated following previous self-harm, although most (80.3%) had a history of recent GP attendance. Mental health diagnoses were present in 84.8% of cases where this variable was documented, and among these, 60.7% had a history of substance misuse and 30.6% had physical health problems. Variables associated with mental illness included gender, older age, previous self-harm episode(s), and presence of drugs in toxicology at time of death. Variables associated with physical illness included older age, death by means other than hanging, and previous self-harm episode(s). CONCLUSIONS: Different factors associated with suicide were identified among people with mental and physical illness and those with and without a diagnosis, and need to be taken into account in suicide prevention. The identified factors highlight the importance of integrated care for dual-diagnosis presentations, restricting access to means, and early recognition and intervention for people with high-risk self-harm.